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FOREWORD 


The  Educational  Technology  and  Simulation  Technical  Area  of  the 
Army  Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI) 
performs  research  and  development  in  areas  of  educational  technology 
with  applicability  to  military  training.  Of  special  interest  is  re- 
search in  the  area  of  large-scale  computer-based  instructional  systems. 
Development  and  implementation  of  such  systems  are  seen  as  a solution 
to  such  current  Army  training  problems  as  a shortage  of  qualified  in- 
structor personnel,  a student  population  of  widely  varying  abilities, 
and  increased  training  costs. 

Technological  advances  in  computer  technology  now  make  it  possi- 
ble to  use  sophisticated  graphics  techniques  in  the  instructional 
process.  Although  it  has  been  assumed  that  the  use  of  such  techniques 
will  improve  training  effectiveness,  scientific  evidence  does  not  con- 
sistently support  this  viewpoint.  This  Technical  Paper  reports  the 
results  of  the  first  phase  of  an  in-house  research  and  exploratory 
project  investigating  the  effectiveness  of  instructional  graphics 
in  computer-based  instructional  systems. 

The  effort  was  initiated  in  response  to  the  requirements  of  Army 
Project  2Q763731A762 , "Computer  Administered  Instruction,"  FY  1975 
Work  Program,  and  was  continued  under  Project  2Q763731A771 , "System 
Embedded  Training  Development,"  FY  1978  Work  Program. 

Dr.  Bruce  W.  Knerr  and  Specialist  5 Peggy  McLintock  contributed 
to  the  development  of  instructional  materials  used  in  the  experiment. 
Personnel  at  the  Learning  Resource  Center,  Dr.  Everett  Rompf,  and 
Mr.  Jack  Ainsworth,  all  of  the  Engineer  School,  Fort  Belvoir,  Va. , 
assisted  in  providing  the  facilities  and  the  personnel  required  to 
conduct  the  experiment. 


j/OSEPH  ZEIDNER 
Technical  Director 


THE  INSTRUCTIONAL  EFFECTIVENESS  OF  THREE  LEVELS  OF  GRAPHICS 
DISPLAYS  FOR  COMPUTER-ASSISTED  INSTRUCTION 


BRIEF 


Requirement : 

To  compare  the  instructional  effectiveness  of  three  different 
types  of  computer  graphics  for  computer-assisted  instruction  (CAI) . 


Procedure : 

Three  groups  of  30  enlisted  personnel  studied  a CAI  lesson  on 
the  psychophysiology  of  audition.  Three  versions  of  the  lesson  were 
developed;  each  version  differed  only  in  the  type  of  graphics  used. 
Graphics  were  either  low  level  (boxed  alphanumerics  and  schematics) , 
medium  level  (line  drawings) , or  high  level  (line  drawings  plus  ani- 
mations) . Upon  lesson  completion,  retention  of  four  knowledge  cate- 
gories addressed  in  the  CAI  lesson  was  tested. 

Findings : 

Groups  did  not  differ  in  their  performance  on  the  final  retention 
tests  or  in  lesson  completion  time.  Performance  was,  however,  related 
to  General  Technical  (GT)  score. 


Utilization  of  Findings: 

The  addition  of  more  realistic  and  sophisticated  graphics  dis- 
plays to  a CAI  lesson  does  not  insure  an  increase  in  instructional  ef- 
fectiveness. A need  exists  to  determine  principles  and  guidelines  for 
the  use  of  graphics  in  computer-based  training. 
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THE  INSTRUCTIONAL  EFFECTIVENESS  OF  THREE  LEVELS  OF  GRAPHICS 
DISPLAYS  FOR  COMPUTER-ASSISTED  INSTRUCTION 


INTRODUCTION 

The  use  of  computers  for  education  and  training  has  increased 
within  the  past  few  years  in  military,  industrial,  and  academic  set- 
tings. Although  much  of  this  activity  reflects  the  use  of  computers 
for  the  management  of  instruction,  a substantial  portion  of  this  ac- 
tivity has  also  been  directed  toward  computer-assisted  instruction 
(CAI) . Major  ob:  teles  to  the  implementation  of  computer-based  edu- 
cation include  the  initial  hardware/software  costs  and  the  follow-on 
cost  of  courseware  development.  In  the  case  of  CAI,  both  cost  factors 
are  greatly  increased  by  the  addition  of  sophisticated  instructional 
capabilities. 

.There  has  been  little  systematic  research  on  characteristics  of 
CAI  that  are  thought  to  optimize  learning,  even  though  it  is  precisely 
these  instructional  capabilities  that  contribute  to  much  of  the  cost 
involved  in  CAI.  For  example,  because  educators  often  assume  that 
there  is  an  intrinsic  instructional  value  in  the  use  of  graphics  to 
supplement  aural  and  textual  presentations,  graphics  displays  are  seen 
as  a desirable  feature  in  CAI  curriculum  development.  Thus,  computer 
graphics  capabilities,  despite  the  additional  procurement  cost,  are 
often  an  important  factor  in  the  design  and  selection  of  a CAI  system. 
Furthermore,  including  graphics  displays  in  a CAI  lesson  increases  les 
son  development  time  and  hence  increases  the  cost  of  courseware. 

A recent  ARI  review  of  the  literature  on  the  use  of  graphics  n 
non-CAI  instruction  (Moore  & Nawrocki,  1978)  concluded  that  there  is 
little  empirical  evidence  to  support  a belief  in  the  effectiveness  of 
graphics : 

First , it  is  clear  that  the  addition  of  graphic  instruc- 
tional material  does  not  guarantee  an  increase  in  in- 
structional effectiveness....  The  second  major  conclu- 
sion is  while  there  do  appear  to  be  conditions  in  which 
graphics  may  be  an  important  adjunct  to  the  instructional 
process,  there  is  currently  no  systematic  means  for 
identifying  these  conditions. 

The  literature  review  did  suggest,  however,  that  a systematic  research 
program  would  best  be  directed  toward  determining  computer  graphics 
effectiveness  as  a function  of  the  type  of  graphics  employed  as  well 
as  of  subject  matter,  learner  task,  and  learner  characteristics.  The 
research  reported  here  is  the  first  in  a series  of  experiments  de- 
signed to  explore  the  instructional  effectiveness  of  computer  graphics 
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The  main  purpose  of  this  experiment  was  to  obtain  data  comparing 
the  instructional  effectiveness  of  several  levels  of  computer  graphics 
and  to  explore  the  interaction  effects  of  levels  of  graphics  with 
identifiable  learner  aptitudes  and  tasks.  King  (1975)  investigated 
the  instructional  effects  of  computer  graphics  in  teaching  the  sine- 
ratio  concept  and  found  no  differences  on  a final  test  in  the  per- 
formance of  groups  receiving  (a)  CAI  text  only,  (b)  CA1  text  plus  ani- 
mated graphics,  or  (c)  CAI  text  plus  still  graphics. 

The  present  experiment  manipulated  three  different  levels  of 
computer  graphics:  high  (animations  plus  line  drawings),  medium  (line 
drawings  only) , and  low  (schematic  representations  and  boxed  alpha- 
numerics)  . Three  versions  of  the  CAI  lesson  on  the  psychophysiology 
of  audition  were  developed.  Each  version  differed  only  in  the  level 
of  graphics  used. 

Psychophysiological  lesson  material  was  selected  because  of  its 
potential  for  graphic  manipulation  and  because  the  idea  that  graphics 
are  necessary  to  teach  this  material  effectively  had  much  face  validity. 
Four  types  of  performance  tests  were  administered  to  all  subjects: 

(a)  acquisition  and  use  of  principles,  (b)  identification  of  struc- 
tures, (c)  definitions  and  use  of  terminology,  and  (d)  memory  of  spe- 
cific facts.  From  these  tests,  information  about  the  role  of  computer 
graphics  for  acquisition  of  specific  knowledge  categories  could  be 
obtained.  Where  available,  aptitude  measures,  such  as  General  Technical 
(GT)  and  Armed  Forces  Qualifying  Test  (AFQT)  scores,  were  used  to  de- 
termine the  extent  of  the  relationship  between  aptitude  and  the  type 
of  graphics  used. 


METHOD 

Subjects 

Subjects  were  90  enlisted  personnel  (7  femalesi  and  83  males)  from 
the  Engineering  School  and  the  Defense  Mapping  School,  both  located  at 
Fort  Belvoir,  Va.  All  subjects  were  high  school  graduates  who  were 
undergoing  advanced  training  at  the  time  of  the  experiment.  Their 
ages  ranged  from  17  to  32  years;  the  mean  age  was  20.01  years. 

Design 

Thirty  subjects  were  randomly  assigned  to  each  of  three  groups. 
All  groups  were  treated  identically,  except  that  level  of  graphics 
displays  during  the  learning  task  was  varied  (either  high,  medium,  or 
low)  between  groups. 
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Lesson  Materials 


The  basic  instruction  consisted  of  a linear  CAI  lesson  on  the 
psychophysiology  of  audition.  The  lesson  comprised  four  sections: 
Section  1 dealt  with  sound  wave  theory;  Section  2 presented  the  anat- 
omy of  the  hearing  mechanisms  of  the  ear;  Section  3 dealt  with  bal- 
ance; and  Section  4 presented  the  range  of  hearing  abilities  and  the 
deterioration  of  range  with  age. 

The  lesson  consisted  of  153  frames.  Each  frame  can  be  defined 
as  a basic  instruction  unit.  Three  frames  presented  introductory 
material,  and  Sections  1-4  presented  43,  27,  16,  and  64  frames,  re- 
spectively. After  approximately  every  third  frame,  students  were 
required  to  answer  either  a forced-choice  or  constructed-answer  ques- 
tion based  on  the  immediately  preceding  material.  Students  were  re- 
quired to  answer  the  question  correctly  in  order  to  continue . 

Each  of  the  four  sections  was  followed  by  a review  containing 
7,  22,  7,  and  25  forced-choice  questions,  respectively.  Subjects 
who  failed  to  answer  85%  of  the  questions  in  a review  correctly  were 
required  to  repeat  the  immediately  preceding  section  until  they  could 
pass  the  review.  In  all  other  cases,  students  progressed  through  the 
frames  in  a linear  order,  but  were  allowed  to  repeat  the  immediately 
preceding  frame  if  they  so  chose. 


Graphics  Levels 

Three  versions  of  the  lesson  on  the  psychophysiology  of  audition 
were  developed.  Versions  were  identical  except  for  the  level  of  com- 
puter graphics  used  during  the  lesson.  The  low  graphics  version  used 
only  schematic  representations  (alphanumerics) ; the  medium  graphics 
version  used  only  line  drawings;  and  the  high  graphics  version  used 
animations  and  line  drawings. 

Figure  1 shows  the  low  graphics  display,  which  was  constructed 
during  a series  of  lesson  frames  on  the  anatomy  of  the  ear.  As  each 
part  of  the  ear  was  discussed  in  order,  from  the  outer  to  the  inner 
ear,  the  corresponding  boxed  alphanumeric  was  added  to  the  computer 
display.  Thus,  the  sequence  of  connections  within  the  ear  was  dis- 
played as  well  as  the  division  into  outer,  middle,  and  inner  ear 
sections,  but  only  at  a schematic  level. 

More  realistic  depictions  of  the  parts  of  the  ear  and  their 
interconnections  were  used  for  the  equivalent  medium  graphics  dis- 
play, as  shown  in  Figure  2.  The  high  graphics  display  showed  the  same 
line  drawing  (Figure  2)  but  in  addition,  after  each  part  of  the  ear 
was  added  to  the  display  and  discussed,  provided  an  animated  simulation 
of  the  movement  of  sound  waves  through  the  ear.  For  example,  after  a 
discussion  of  the  bones  of  the  middle  ear  (hammer,  anvil,  and  stirrup). 
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AUDITORY  NERVE 

The  auditory  nerve  leads  directly  to  the 
brain,  which  is  only  about  3/4  inch  away.  In 
the  brain  the  message  is  translated  into  what 
you  "hear"  as  "sound". 


Figure  1.  Example  of  low  graphics  level  lesson  frame. 
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AUDITORY  NERVE 

The  auditory  nerve  leads  directly  to  the 
brain,  which  is  only  about  3/4  inch  away.  In 
the  brain  the  message  is  translated  into  what 
you  "hear"  as  “sound. " 


Figure  2.  Example  of  medium  graphics  level  lesson  frame. 


a musical  note  would  move  through  the  ear  canal,  the  ear  drum  would 
vibrate,  then  the  middle  ear  bones  would  move  in  sequence. 


Attitude  Survey 

Data  on  attitudes  toward  CAI  were  also  collected  on  line  for  each 
subject.  The  attitude  survey  (Knerr  & Nawrocki,  1978)  consisted  of 
a 13-item  Likert-scaled  pretest  and  a 37-item  posttest.  Possible 
scores  on  each  item  ranged  from  1 to  5,  a score  of  1 indicating  an 
unfavorable  attitude  toward  CAI;  3,  a neutral  attitude;  and  5,  a very 
favorable  attitude.  The  posttest  employed  13  pretest  items,  phrased 
in  the  past  tense,  and  24  new  items.  The  internal  consistency  relia- 
bility of  each  test  is  reported  to  be  .88  and  .93,  respectively. 


Dependent  Measures 

Five  dependent  measures  were  used:  time  to  complete  the  lesson 
and  scores  on  the  four  content  tests:  Facts,  Terminology,  Identifi- 
cation, and  Principles.  The  Facts  Test  consisted  of  20  true/false 
and  multiple-choice  items  developed  to  test  the  subject's  knowledge 
about  the  qualitative  and  quantitative  modifiers  described  in  the 
lesson.  The  Terminology  Test  consisted  of  13  matching  items  designed 
to  assess  the  subject's  knowledge  of  the  function  of  the  parts  of  the 
ear  and  knowledge  of  terms  used  in  the  lesson.  The  Identification 
Test  consisted  of  14  multiple-choice  items  which  tested  the  subject's 
knowledge  of  the  location  and/or  structure  of  the  parts  of  the  ear. 

The  Principles  Test  consisted  of  21  true/false  and  multiple-choice 
items  which  tested  knowledge  of  the  principles  and  theories  discussed 
in  the  lesson.  Prior  to  assembling  these  tests  in  final  form,  four 
raters  judged  each  test  item  as  to  the  category  of  knowledge  it  tested. 
When  disagreements  were  noted,  the  item  was  eliminated. 


Apparatus 

Except  for  pre-  and  postdebriefing  sheets,  all  instruction  and 
data  collection  took  place  via  one  of  four  PLATO  IV  terminals  located 
at  the  Learning  Resource  Center  of  the  Engineer  School,  Fort  Belvoir, 
Va.  The  hardware  of  the  PLATO  IV  computer-based  education  system  has 
been  described  by  Stifle  (1972).  Each  terminal  consists  of  an  8.5-inch 
square  plasma  display  panel  and  associated  typewriter  keyboard.  Ter- 
minals were  connected  via  dedicated  telephone  lines  to  a CDC  6500  com- 
puter located  at  the  University  of  Illinois. 1 


Commercial  designations  are  used  for  precision  of  reporting.  Their 
use  does  not  constitute  endorsement  by  the  Army  Research  Institute 
or  the  U.S.  Army. 
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Procedures 


Upon  arrival  at  the  Learning  Resource  Center,  subjects  were 
briefed  about  the  purpose  of  the  experiment.  Subjects  were  randomly 
assigned  to  one  of  the  three  graphics  levels,  and  then  taken  to  the 
computer  terminals.  The  experimenter  signed  subjects  onto  the  PLATO 
IV  system.  The  subjects  first  studied  a brief  CAI  lesson  on  the  use 
of  the  keyset,  then  proceeded  through  the  on-line  experimental  materi- 
als in  the  following  order:  a biographic  information  sheet.  Attitude 
Towards  CAI  Pretest,  the  CAI  lesson  on  the  psychophysiology  of  audi- 
tion at  the  selected  graphics  level.  Facts  Test,  Terminology  Test, 
Identification  Test,  Principles  Test,  and  Attitude  Towards  CAI  Posttest. 


RESULTS 


Performance  Measures 


The  time  taken  to  complete  the  four  sections  of  the  lesson  and 
the  four  review  sections  was  tallied  and  combined  as  a single  figure 
designated  lesson  completion  time.  Table  1 presents  the  mean  lesson 
completion  time  for  each  of  the  three  graphics  levels.  A one-way 
analysis  of  variance  performed  on  the  lesson  completion  times  indi- 
cated that  the  three  graphics  groups  were  not  significantly  different: 
F{2,  87)  = .02. 


Table  1 

Mean  Lesson  Completion  Time  for  the  Low,  Medium,  and 
High  Graphics  Level 


Graphics  level 

Mean  (in  minutes) 

Low 

108.00 

Medium 

106.82 

High 

108.86 

The  number  of  correct  items  was  tallied  for  each  subject  for 
each  of  the  four  content  tests.  This  number  was  then  converted  to 
percent  correct.  The  mean  percent  correct  for  each  of  the  three 
graphics  groups  for  each  of  the  four  tests  is  presented  in  Table  2. 


Table  2 


Mean  Percent  Correct  for  the  Low,  Medium,  and  High 
Graphics  Level  Groups  on  the  Four  Content  Tests 


Content  test 

Graphics  level 

Low 

Medium 

High 

Facts 

84.33 

83.50 

86.00 

Terminology 

83.59 

78.20 

83.84 

Identification 

81.90 

82.14 

84.28 

Principles 

70.00 

67.93 

72.38 

The  one-way  analysis  of  variance  performed  on  the  percent  correct 
data  for  each  of  the  four  content  tests  resulted  in  no  significant 
differences  among  high,  medium,  and  low  graphics  groups  for  any  of  the 
analyses  performed:  Facts  Test  F(2,  87)  = .44;  Terminology  Test 
F(2,  87)  = 1.20;  Identification  Test  F(2,  87)  = .42;  and  Principles 
Test  F (2 , 87)  = 1.07. 

Thus,  the  initial  data  analyses  indicated  that  the  level  of  com- 
puter graphics  employed  in  the  lesson  was  not  a significant  determinant 
of  success  on  the  content  tests  or  of  time  spent  on  the  lesson. 


Aptitude  and  Performance 

Subject  performance  was  further  analyzed  with  respect  to  general- 
ized aptitude.  GT  scores  were  available  for  about  half  the  subjects 
(n  = 51) . Armed  Forces  Qualification  Test  (AFQT)  scores  were  also 
available  for  about  half  the  subjects  (n  = 49) . The  subject  popula- 
tions in  the  GT  and  AFQT  subsampies  overlapped  considerably  and  the 
aptitude  scores  were  correlated  with  each  other,  r(45)  =■  .87,  p < .01. 
Because  correlation  between  aptitude  test  and  performance  variables 
was  greater  in  the  GT  subsample  (range  of  r values:  .49  to  .66)  than 
in  the  AFQT  suosample  (range  of  r values:  .43  to  .63),  the  results 
of  only  one  subsample,  the  GT  subsample,  will  be  considered  here. 

For  analysis  purposes,  the  51  subjects  for  whom  GT  scores  were 
available  were  classified  as  being  high  GT  scorers  (118-140) , medium 
GT  scorers  (106-116) , or  low  GT  scorers  (90-104) . Cutoff  points  for 
the  division  into  groups  were  determined  by  first  rank-ordering  all 
available  GT  scores  and  then  dividing  the  scores  into  approximate 
upper,  middle,  and  lower  thirds  so  that  high,  medium,  and  low  GT 
scores  were  about  equally  represented  in  the  three  graphics  level 


conditions.  Table  3 shows  the  mean  GT  scores  for  each  of  the  nine 
groups. 


Table  3 

Mean  GT  Score  for  Subjects  in  the  Low,  Medium,  and 
High  Graphics  Level  Groups  Classified  as  Low, 
Medium,  or  High  GT  Scorers 


GT  score 

Graphics  level 

Low 

Medium 

High 

Low  (90-104) 

94.00 

98.5 

101.43 

(4) 

(6) 

(7) 

Medium  (106-116) 

112.40 

110.33 

111.33 

(5) 

(7) 

(6) 

High  (118-140) 

131.60 

126.00 

122.17 

(5) 

(5) 

(6) 

Note.  The  number  of  scores  contributing  to  each  mean  is  shown  in 
parentheses. 


The  performance  of  the  GT  subsample  for  each  of  the  five  depen- 
dent measures  was  analyzed  using  two  factor  analyses  of  variance  with 
both  factors  (GT  score  and  graphics  level)  as  between  subject  factors. 

Content  Tests.  Tables  4 to  7 show  the  mean  scores  on  each  con- 
tent test  as  a function  of  graphics  level  and  GT  score  category. 
Consistent  with  the  results  for  the  entire  sample,  there  were  no  major 
effects  of  graphics  level  in  the  GT  subsample  on  any  of  the  four  con- 
tent tests:  F(2,  42)  = 2.77  for  the  Facts  Test,  .93  for  the  Termi- 
nology Test,  1.10  for  the  Identification  Test,  and  .29  for  the  Princi- 
ples Test. 

For  the  GT  subsample,  performance  on  each  content  test  improved 
with  aptitude  level:  F(2,  42)  = 9.62  for  the  Facts  Test,  5.34  for  the 
Terminology  Test,  12.43  for  the  Identification  Test,  and  '8.74  for  the 
Principles  Test;  p < .01  in  all  cases.  Graphics  level  and  GT  category 
did  not  interact:  F(4,  42)  = .72  for  the  Facts  Test,  .22  for  the 
Terminology  Test,  1.41  for  the  Identification  Test,  and  1.10  for  the 
Principles  Test. 


Table  7 


Mean  Score  on  the  Principles  Test  as  a Function  of 
Graphics  Level  and  GT  Score 


Graphics  level 

GT  score 

Low 

Medium 

High 

Low 

Medium 

High 

59.52 

65.71 

80.95 

56.34 

69.38 

74.28 

68.70 

61.90 

78.57 

Time.  Table  8 shows  the  mean  lesson  completion  time  for  each 
group.  The  analysis  of  variance  indicated  a reliable  interaction 
between  graphics  level  and  GT  score  category,  F(4,  42)  = 3.35,  p < .05, 
Scheffe  tests  at  the  .05  level  indicated  that  in  the  high  and  low 
graphics  level  groups  low  GT  scorers  took  longer  to  complete  the  les- 
son than  did  medium  and  high  GT  scorers,  whose  time  did  not  differ. 

GT  score  category  had  no  effect  on  lesson  completion  time  for  subjects 
in  the  medium  graphics  level  groups,  however. 

Table  8 

Mean  Completion  Time  (in  Minutes)  as  a Function 
of  Graphics  Level  and  GT  Score 

Graphics  level 

GT  score 

Low 

Medium 

High 

Low 

Medium 

High 

167.45 

88.94 

85.48 

125.01 

119.57 

71.38 

140.20 

85.23 

78.15 

Attitude 

Toward  CAI 

The  scores  for  each  subject  for  each  item  on  the  pre-  and  post- 
test attitude  surveys  were  summed  to  obtain  a total  score  for  each 
subject  for  each  test.  Scores  for  each  item  for  each  test  could  range 
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from  1 to  5,  a higher  score  indicating  a more  favorable  attitude 
toward  CAI.  The  maximum  score  possible  is  65  (13  items  x 5)  on  the 
pretest  and  185  (37  items  x 5)  on  the  posttest.  Table  9 shows  the 
mean  score  on  both  tests  for  the  three  graphics  level  groups.  Be- 
cause pre-  and  posttest  scores  were  correlated  (Pearson  Product  Moment 
coefficient  = .71,  p < .01),  an  analysis  of  covariance  on  the  posttest 
scores  with  pretest  scores  as  the  covariate  was  performed.  The  analy- 
sis of  covariance  indicated  no  differences  between  graphics  groups  on 
posttest  attitude  toward  CAI,  F(2,  86)  = 1.33. 


Table  9 

Mean  Pre-  and  Posttest  Attitude  Toward  CAI  Scores  for  the 
Low,  Medium,  and  High  Graphics  Level  Groups 


Graphics  level 

Test 

Measure 

High 

Medium 

Low 

Pretest 

X 

46.53 

45.83 

45.37 

Posttest 

X 

143.97 

137.43 

136.43 

Knerr  (1978)  reported  additional  analyses  of  the  attitude  data. 


CONCLUSIONS 

The  results  of  the  present  experiment  on  the  comparative  instruc- 
tional effectiveness  of  three  levels  of  computer  graphics  can  be  brief- 
ly summarized.  Level  of  computer  graphics  during  learning  had  no  ef- 
fect on  final  performance.  Subjects  receiving  simple  graphics,  such 
as  boxed  alphanumerics , combined  with  a textual  CAI  presentation  per- 
formed at  the  same  levels  as  subjects  receiving  more  realistic  visual 
displays  and  animations.  Although  performance  on  the  content  tests 
improved  in  the  GT  subsample  as  a function  of  aptitude  as  measured  by 
the  GT  test,  there  were  no  indications  of  any  aptitude  x treatment 
interactions.  For  the  GT  subsample,  however,  time  to  complete  the 
lesson  depended  on  graphics  level  and  GT  score  category:  Subjects  in 
the  medium  and  high  GT  categories  took  less  time  to  complete  the  les- 
son than  did  subjects  in  the  low  GT  category  for  the  low  and  high 
graphics  level  versions  of  the  lesson.  Aptitude  had  no  statistical 
effect  on  time  to  complete  the  medium  level  graphics  version  of  the 
lesson.  Practical  applications  of  this  finding  are  unclear,  however, 
particularly  because , in  all  cases , low  GT  scorers  took  approximately 
twice  as  long  to  complete  the  lesson  as  high  aptitude  scorers,  even 
for  subjects  in  the  medium  level  graphics  group. 
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The  failure  to  find  differential  effects  for  level  of  computer 
graphics  is  consistent  with  King's  (1975)  finding.  Indeed,  these 
two  results  suggest  that  unless  the  role  of  graphics  in  CAI  is  more 
clearly  delineated,  minimal  graphics,  if  any,  may  be  sufficient  for 
effective  instruction. 

The  experimental  approach  in  this  and  King's  (1975)  study  was  to 
devise  a fairly  complete  and  lengthy  instructional  sequence  and  to 
test  retention  after  instruction.  In  the  present  study  and  presum- 
ably in  the  King  (1975)  study,  an  attempt  was  made  to  incorporate 
sound  instructional  practices  over  and  above  the  use  of  computer 
graphics.  For  example,  in  the  lesson  on  the  psychophysiology  of 
audition,  if  students  failed  to  meet  a stringent  criterion  on  one 
section  of  the  lesson,  they  were  required  to  repeat  that  section  be- 
fore continuing  to  the  next  section.  Information  was  given  to  a stu- 
dent gradually,  so  that  new  knowledge  could  be  built  on  previous 
knowledge.  This  strategy  was  used  both  between  and  within  lesson 
sections.  As  a result,  subjects  achieved  good  scores  on  the  final 
retention  tests.  On  the  probable  assumption  that  the  subjects  as  a 
whole  did  not  have  high  preexperimental  knowledge  of  the  content 
areas,  learning  of  the  material  resulted  primarily  from  exposure  to 
the  CAI  lesson.  Any  potential  effects  of  graphics  during  learning 
may  have  been  masked  by  the  apparent  ceiling  effects  obtained  on  the 
retention  tests. 

It  now  appears  that  the  experimental  approach  of  designing  sound 
instructional  CAI  material  that  uses  different  levels  of  computer 
graphics  and  of  testing  for  retention  after  learning  is  not  a fruit- 
ful way  to  investigate  the  role  of  graphics  in  instruction.  If  graph- 
ics do  enhance  instructional  effectiveness  in  any  way,  as  most  edu- 
cators appear  to  believe,  their  influence  must  be  subtle,  and  more 
refined  techniques  would  be  necessary  to  discover  their  instructional 
role.  Perhaps  the  question  which  should  be  asked  about  the  role  of 
graphics  in  instruction  is  not,  "Are  more  complex  graphics  better  than 
less  complex  graphics?"  but  rather,  "When,  where,  how,  and  with  whom 
are  graphics  to  be  used?" 

Possible  approaches  to  be  considered  include  exploring  the  role 
of  graphics  during  the  learning  process  in  addition  to  their  role  in 
retention  (immediate  and  more  long  term)  of  learned  material.  Con- 
tent areas  which  require  interaction  with  the  visual  world  should 
also  be  explored;  performance-oriented  activities  such  as  vehicular 
maintenance  require  visual  knowledge  to  a greater  extent  than  more 
conceptual  areas  such  as  audition  or  the  sine-ratio  concept.  Corre- 
spondingly, tests  which  require  the  use  of  visual  information  rather 
tham  those  which  place  a heavy  reliance  on  text  should  be  used  as 
dependent  measures.  There  is  also  increasing  evidence  that  individu- 
als differ  in  their  spatial  abilities  (Kozlowski  & Bryant,  1977).  It 
may  be  that  the  instructional  effectiveness  of  graphics  varies  with 
an  individual's  spatial  aptitude. 
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CAI's  greatest  potential  appears  to  be  its  capability  to  indi- 
vidualize instruction  using  interactive  techniques.  Just  as  textual 
material  can  be  presented  in  an  interactive  mode,  so  too  can  graphics. 
The  applications  of  interactive  graphics  to  instruction  may  be  a 
fruitful  area  of  investigation. 

As  a final  note,  all  three  versions  of  the  lesson  on  the  psycho- 
physiology of  audition  are  currently  available  on  the  University  of 
Illinois  PLATO  system.  The  high  graphics  level  version  was  selected 
as  part  of  the  Biology  PLATO  Curriculum.  In  the  6-month  period  from 
1 January  to  1 July  1978,  over  250  students  at  colleges  and  universi- 
ties in  various  locations  across  the  country  successfully  completed 
the  lesson. 
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1 USA  Cmd  & General  Stf  Col.fge.  Ft  Leavenworth,  ATTN-  ATSW  -S\ 

1 USA  Cmd  & General  Stf  CoLeoe,  Ft  Lea*er.wortb,  ATTN.  Ed  AdvJv' 

1 USA  Combined  Arms  Cmbt  0*:*  Act.  Ft  Leavenworth.  ATTN:  DepCd' 

1 USA  Combined  Arms  Cmbt  Dev  Act.  Ft  Leavenworth.  ATTN:  CCS 

1 USA  Combined  Arms  Cmbt  Dev  Act.  Ft  Leavenworth,  ATTN:  4TCA-  * 

1 USA  Combined  Arms  Cmbt  Dev  Act,  F*  Leavenworth,  ATTN:  fO  C V*  • 

1 USA  Combined  Arms  Cnr.b;  Dev  Ac.,  Ft  Leavenworth.  ATTN:  AT C ACC  ^ 

1 USA  F COM.  N-gh!  Vision  La*.;,  ft  5«1voir.  ATTN:  AMSEL  NV-VD 

3 USA  Computer  Sys  Cmd.  Ft  muveir,  ATTN:  Ted*  Library 
1 USAMFRDC,  Ft  Belvcir.  ATTN:  STSFE-  DQ 

1 USA  Eng  Sch,  Ft  Belvpir,  ATTN:  Library 
1 USA  Topographic  Lab.  Ft  Belv- • r.  ATTN:  ETL— TD--S 
1 USA  Topngraphic  Lab.  Ft  Belvo*r,  ATTN:  STINFO  Center 
1 USA  Topographic  Lab.  Ft  Renoir.  ATTN:  ETL— GSL 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca.  ATTN:  CTD— MS 
1 USA  Intelligence  Ctr  & Sch.  Ft  Huachuca,  ATTN:  ATS -CTD— MS 
1 USA  intelligence  Ctr  & Sch.  F*.  Huachuca,  ATTN:  ATSI— TE 
1 USA  Intelligence  Ctr  & $:!i,  F : Huachuca,  ATTN:  ATSI— TEX-GS 
1 USA  Intelligence  Ctr  & Sch.  Ft  Huachuca.  ATTN:  ATSi-CTS  -OF 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN:  A’i SI-CTD— Dl 
1 USA  Intelligence  Ctr  & Sch.  Ft  Huachuca,  ATi'N:  ATSl-CTD-CS 
1 USA  Intelligence  Ctr  rV  Sch,  Ft  Huachuca.  ATTN:  DAS/SRD 
1 USA  Intelligence  Ctr  & Sch,  F t Huachuca.  ATTN:  ATSi-TEV 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN:  Library 

1 CDR,  HQ  Ft  Huachuca.  ATTN  Tech  Ref  Div 

2 CDR.  USA  Electronic  Prvg  Gni.  ATTN:  STEEP  MT-S 
1 HQ,  TCATA,  ATTN:  Tech  Library 

1 HQ.  TCATA,  ATTN:  AT  CAT-OP-Q.  Ft  Hood 
1 USA  Recruiting  Cmd,  Ft  Sheridan,  ATTN:  USARCPM-P 
I Senior  Army  Adv.,  USAFAGOD/TAC.  Elgin  AF  Aux  Fid  No.  9 
1 HQ  USARPAC,  DCSPER.  APO  SF  96 5S8,  ATTN:  GPPE  SF 
1 Stimson  Lib,  Academy  of  Health  Sciences,  Ft  Sam  Houston 
1 Marine  Corps  Inst.,  ATTN:  Dean-MCI 
1 HQUSMC,  Commandant,  ATTN:  Code  MTMT 

1 HQUSMC,  Commandant,  ATTNi  Code  MPl -2 0-2 8 

2 USCG  Academy,  New  London,  ATTN:  Admission 
2 USCG  Academy,  New  London,  ATTN:  Library 

1 USCG  Training  Ctr,  NY,  ATTN:  CO 
1 USCG  Training  Ctr,  NY,  ATTNi  Educ  Svc  Ofc 
1 USCG,  Psychol  Res  Br,  DC.  ATTN:  GP  1 /6  2 
1 HQ  Mid-Range  Br.  MC  Det,  Quantico,  ATTN:  PX.S  Div 
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1  US  Marine  Corps  Liaision  Ofc,  AMC,  Alexandria,  ATTN:  AMCGS— F 
1 USATRADOC,  Ft  Monroe,  ATTN:  ATRO-ED 
6 USATRADOC,  Ft  Monroe,  ATTN:  ATPR-AD 
1 USATRADOC,  Ft  Monroe.  ATTN:  ATTS-E A 

1 USA  Forces  Cmd,  Ft  McPherson.  ATTN:  Library 

2 USA  Aviation  Test  Bd,  Ft  Rucker,  ATTN:  STEBG— PO 

1  USA  Agcy  for  Aviation  Safety,  Ft  Rucker,  ATTN:  Library 
1 USA  Agcy  for  Aviation  Safety,  Ft  Rucker,  ATTN:  Educ  Advisor 
1 USA  Aviation  Sch.  Ft  Rucker,  ATTN:  PO  Drawer  O 

1 HQUSA  Aviation  Sys  Cmd,  St  Louis,  ATTN:  AMSAV— ZDR 

2 USA  Aviation  Sys  Test  Act.,  Edwards  AFB,  ATTN:  SAVTE— T 
1 USA  Air  Def  Sch,  Ft  Bliss.  ATTN:  ATSA  TEM 

1 USA  Air  Mobility  Rsch  & Dev  Lab.  Moffett  Fid.  ATTN:  SAVDL-AS 
1 USA  Aviation  Sch,  Res  Tng  Mgt,  Ft  Rucker,  ATTN:  ATST— T— RTM 
1 USA  Aviation  Sch,  CO,  Ft  Rucker,  ATTN:  ATST— D— A 
1 HQ.  DARCOM,  Alexandria,  ATTN:  AMXCD-TL 
1 HQ.  DARCOM,  Alexandria,  ATTN:  CDR 
1 US  Military  Academy,  West  Point,  ATTN:  Serials  Unit 
1 US  Military  Academy,  West  Point,  ATTN:  Ofc  of  Milt  Ldrshp 
1 US  Military  Academy,  West  Point.  ATTN:  MAOR 
1 USA  Standardization  Gp,  UK.  FPO  NY,  ATTN:  MASE-GC 
1 Ofc  of  Naval  Rsch,  Arlington,  ATTN:  Code  4S2 

3 Ofc  of  Naval  Rsch,  Arlington,  ATTN:  Code  468 
1 Ofc  of  Naval  Rsch,  Arlington,  ATTN:  Code  450 
1 Ofc  of  Naval  Rsch,  Arlington,  ATTN:  Code  441 

1 Naval  Aerospc  Med  Res  Lab,  Pensacola,  ATTN:  Acous  Sch  Div 
1 Naval  Aerospc  Med  Res  Lab,  Pensacola,  ATTN:  Code  LSI 
1 Naval  Aerospc  Med  Res  Lab,  Pensacola,  ATTN:  Code  L5 
1 Chief  of  NavPers,  ATTN:  Pers-OR 
1 NAVAIRSTA.  Norfolk,  ATTN:  Safety  Ctr 
1 Nav  Oceanographic.  DC.  ATTN:  Code  6261,  Charts  & Tech 
1 Center  of  Naval  Anal,  ATTN : Doc  Ctr 
1 NavAirSysCom,  ATTN:  AIR-531X 
1 Nav  BuMed,  ATTN:  713 
1 NavHelicopterSubSqua  2,  FPO  SF  96601 
1 AFHRL  (FT)  William  AFB 
1 AFHRL  <TT)  Lowry  AFB 

1 AFHRL  (AS)  WPAFB.  OH 

2 AFHRL  (DOJZ)  Brooks  AFB 

1 AFHRL  IDOJN)  Lackland  AFB 
1 HQUSAF  (INYSD) 

1 HQUSAF  (DPXXA) 

1 AFVTG  (RD)  Randolph  AFB 

3 AMRL  (HE)  WPAFB,  OH 

2 AF  Inst  of  Tech,  WPAFB,  OH,  ATTN:  ENE/SL 
1 ATC  (XPTD)  Randolph  AFB 

1 USAF  AeroMed  Lib,  Brooks  AFB  (SUL-4),  ATTN:  DOC  SEC 
1 AFOSR  INL),  Arlington 

1 AF  Log  Cmd,  McClellan  AFB,  ATTN:  ALC/DPCRB 

1 Air  Force  Academy,  CO,  ATTN:  Dept  of  Bel  Sen 
5 NavPers  & Dev  Ctr,  San  Diego 

2 Navy  Med  Neuropsychiatric  Rsch  Unit,  San  Diego 
1 Nav  Electronic  Lab,  San  Diego,  ATTN:  Res  Lab 

1 Nav  TrngCen,  San  Diego,  ATTN:  Code  9000-Lib 
1 NavPostGraSch,  Monterey,  ATTN:  Code  56Aa 
1 NavPostGraSch,  Monterey,  ATTN:  Code  2124 
1 NavTrngEquipCtr,  Orlando,  ATTN:  Tech  Lib 
1 US  Dept  of  Labor,  DC,  ATTN:  Manpower  Admin 
1 US  Dept  of  Justice,  DC,  ATTN:  Drug  Enforce  Admin 
1 Nat  Bur  of  Standards,  DC,  ATTN:  Computer  Info  Section 
1 Nat  Clearing  Houso  for  MH— Info,  Rockville 
1 Denver  Federal  Ctr,  Lakewood,  ATTN:  BLM 
12  Defense  Documentation  Center 

4 Dir  Psych,  Army  Hq,  Russell  Ofcs,  Canberra 

1 Scientific  Advsr,  Mil  Bd,  Army  Hq,  Russell  Ofcs,  Canberra 
1 Mil  and  Air  Attache,  Austrian  Embassy 

1 Centre  de  Recherche  Des  Facteurs.  Humaine  de  la  Defense 
Nationals.  Brussels 

2 Canadian  Joint  Staff  Washington 

1 C/Air  Staff,  Royal  Canadian  AF,  ATTN:  Pert  Std  Anal  Br 

3 Chief,  Canadian  Def  Rsch  Staff.  ATTN:  C/CRDS<W) 

4 British  Def  Staff,  British  Embassy,  Washington 


1 Def  & Civil  Inst  of  Enviro  Medicine.  Canada 
1 AIR  CRESS,  Kensington.  ATTN:  Info  Sys  Br 
1 Mllitaarpcykologisk  Tjenaste,  Copehapen 
1 Military  Attache,  French  Embassy,  ATTN:  Doc  Sec 
1 Medecin  Chef,  C.E.RP.A. -Arsenal.  Toulon/Naval  Franca 
1 Prin  Scientific  Off,  Appl  Hum  Engr  Rsch  Div.  Ministry 
of  Defense.  New  Delhi 

1 Pars  Rsch  Ofc  Library,  AKA.  Israel  Defense  Forces 
1 Ministeris  van  Defenaie.  DOOP/KL  Afd  Sociael 
Psychoiogiache  Zaken,  The  Hague,  Netherlands 
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